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In  dealing  with  a  complex  envlroQnsnt,  a  person  organises  bis  eagperience 
in  sooe  manner  that  is  little  understood  by  psychologists.  Investigation  of 
this  "encoding"  or  "soheoatising"  process  is  of  considerable  iqportance. 


Until  19$$,  concept-formation  experloenta  had  sanerally  been  restricted 
io  the  analysis  of  a  nuniber-ric^t  score,  so  that  the  emargnoee  of  a  concept 
Ls  described  quantitatively  and  not  qualitatively.  Brunswik  (19^7)  had 
luggested  that  perceptual  learning  be  studied  by  examining  the  "crlteriallties" 
>f  the  various  cues  in  the  stlmulua-fleld,  l.e.,  the  dependencies  UniHwg  the 
ihbjeet's  response  to  the  cues.  !Ehia  proposal  enables  us  to  elicit  more 
^.Jnfonaatlon  from  an  esveriment  than  is  poravlded  by  the  conventional  learning 
^^core,  which  counts  coincidences  between  the  subject's  responses  and  a  key. 

Smedslund  applied  Brunswlk's  concepts  to  a  task  in  idilch  the  subject 
vaa  required  to  make  Judgoiants  about  a  series  of  complexly  varying  stimulus 
""^figures .  ixkdlcatlng  what  position  on  a  numerical  scale  corresponded  to  the 
3ngire.  The  correct  answer  was  calculated  by  the  experliaenter  aa  a  linear 
'"^''function  of  certain  measures  of  the  figure.  Smedslund 's  task  proved  exceed- 
Ingly  difficult  for  his  subjects,  both  because  his  figures  were  unstructured 
C  end  because  the  feedback  following  each  response  conalsted  not  of  the  correct 
answer  but  of  that  answer  plus  a  random  "error."  As  a  result,  cues  developed 
crlterlality  for  the  subjects  very  slowly.  No  substantial  generalisations 
emerged  frcni  the.  study,  though  it  was  an  important  pioneering  step. 


Whereas  Smedslund 's  study  was  closely  modeled  on  Brunswlk's  theory  of 
probabilistic  perceptual  learning,  Bruner  and  his  students  extended  crlterlality 
analysis  to  concept -formation  tasks  in  which  responses  are  presumed  to  be 
Intellectually  mediated.  Xhe  study  of  Robert  Ooodnow  (see  Bruner,  Qoodnow, 
and  Austin,  19$6)  presented  airplane  silhouettes  varying  in  three  respects. 

From  one  to  three  of  these  two-valued  cues  were  present  nn  any  one  trial, 
frcm  which  S  was  to  Judge  whether  the  plane  shown  was  friend  or  enemy;  agedn# 
feedback  was  provided  to  allow  8  to  learn  to  classify.  In  this  study  also, 
probabilistic  considerations  loobed  very  large,  since  the  investigatore  trere 
concemed  with  ^'s  response  on  trials  vhe2re  information  was  Incomplete. 


In  Initiating  the  present  study,  we  entertained  a  l^pothesis  roughly 
started  as  follows:  When  a  person  encounters  a  series  of  objects  (events, 
tlgiaea)  of  a  certain  type  and  observes  certain  associated  properties  or 
consequences,  he  will  come  to  rely  on  certain  aspects  of  the  object  as 
predictors.  Ultimately,  be  will  develop  a  "theory"  about  the  class  of 
objects,  so  that  from  its  characteristics  he  can  predict  vdilch  of  the 
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poftsibl*  eatuMqMcnoM  will  occur,  be  will  infer  tb«  pros«rtl«s  of  the 

object  fron  eeleeted  data.  Wbile  thle  lorooesa  is  frequently  yereeptual  and 
unvarbaliaad,  with  oontinuad  e:gperlenoa  a  parson  should  be  able  to  devslop 
ejqpUeltly  fOmulated  rules  for  tbs  predictions.  (Mytoh  of  bl^ier  education 
la  Intended  to  facilitate  just  sueb  tbeoarlsing.)  A  hey  step  in  tbls 
bypotbsslsed  process  Is  Idsntlfleatlon  of  diMsnsions  or  constructs,  l.e., 
the  structuring  of  tbs  stlnulue  set.  It  eas  our  bypotbesls  that  tbe  payson 
invents  diaenslfwin  for  thinking  about  unfaaillsr  stiaull  objects,  or,  nore 
speelfioally,  that  from  tbe  indefinitely  large  nad&er  of  partly  redundant 
attributes  that  could  be  used  to  describe  differences  among  tbe  stiaull, 
be  selects  certain  ones  that  bo  often  finds  relevant  to  criteria,  and  tbere- 
after  uses  these  attributes  as  a  ftrameenrk  In  establlsblng  predl^ve  lavs 
even  for  new  criteria.  It  vas  our  long-range  program,  tberefore,  to  study 
tbe  process  by  idilcb,  tbrou^  a  sorles  of  conoept-foriBation  tasks  lanrolving 
the  same  stlnalus-faally,  the  person  develppe  a  conceptual  structure  regard¬ 
ing  that  family. 

We  proposed  to  use  the  correlational  measure  of  criteriallty  suggested 
by  Brunswlk  to  identify  each  std>ject*s  reliance  on  each  stiaulus  aspect  at 
various  stages  in  training.  In  particular,  ve  hoped  that  tbe  crlteriallties 
vould  provide  an  objective  indication  of  tte  "hypotbesas”  snminn'fcing  8 'a 
reaponaa  at  any  point,  ao  ttot  ue  could  eaperinentally  ftxsnflna  tbe  extent  ,  to 
idileh  verbalisation  belpe  hinders  learning.  Whereas  Brunar  bad  dealt 
with  stlmilua  sets  described  by  a  small  nuatoer  of  interaaetiag  attributes, 
saeh  tiro-  or  tbrse-valusd,  «e  proposed  to  use  stiaull  varying  contlnuoualy 
in  several  dimensions.  In  Bruner's  ease,  the  attributes  to  be  considered  ' 
are  eiqilieitly  identified  and  8  has  only  to  learn  tbalr  relavance;  ve  viah^ 
to  study  8 'a  alicitatlon  of  attelbutas  from  a  rather  unstructured  situation, 
lbs  f irst*' step  in  our  projpraa  was  to  estsblisb  that  erita].*laIitleB  couM  be 
deteralaed  and  interpreted.  Our  two  years  of  experimentation  led  to  tbe 
conclusion  that  the  oriterlallty  model  is  seriously  inadequate,  and  that 
designs  radically  different  from  Ihose  employed  in  our  studies  and  those  ot 
our  predecessors  are  required  to  obtain  information  about  tbs  enneept- 
inventlon  process. 

The  chrraology  of  our  experiamntatlon  vas  as  foUovs:  Frier  to  initia¬ 
tion  of  the  project  (July  1^60),  Hiroshi  Asuaa  gatbsrsd  data  (under  Crobbaeb's 
direction)  for  a  dissertation  idilch  he  cooOleted  under  tbe  diractlon  of  L.  N. 
Stolurov  in  suianer  i960.  There  vere  four  subgroups  in  this  study.  Gbroup  1 
was  confronted  with  a  "deterministic"  situation  in  idilcb  tbs  correct  sower 
k  was  perfectly  correlated  with  certain  atlaulus  infoonaatlon.  Oxtup  II  vas 
confronted  with  a  probabilistic  situation  in  idiicb  the  oorreet  answer  vas 
only  probabilistically  related  to  stimulua  informatloa.  (Oroupa  III  and  IV 
vere  not  studied  in  this  project.)  The  dlasertation  employed  criteriaU'^ 
analysis,  hut  drew  ooncluslons  only  from  criteriallty  curves  reporaaenting 
group  stveragBB.  Thia  could  not  give  InslcJit  into  tbe  process  of  bypotbesla 
famation  by  individuals,  and  ouch  of  I960-6I  vas  devoted  to  re-analysla  of 
these  data  to  study  individual  crltarlalltiaa.  In  the  aunBer  and  fall  of 
1961,  another  experiment  was  run  with  a  detaminlatie  prOhLam.  In  describing 
tbe  work,  ve  will  consider  first  the  studies  under  deterulnlstio  coudltiixas, 
diseussli^  emparience  with  crlterlcdity  analysis  before  g^ing  on  to  results. 


D«ta«lnl»tle  concept  foonaatlon 


^  cgiterlcllty  aodal,  OSm  principal  l>arrier  to  the  study  of  concept 
ixxventloa  proves  to  be  the  extrema  difficulty  of  the  task,  even  for  mature 
svfbjeets.  Inherent  in  our  conception  (foUoving  Brunsvik/  is  the  idea  that 
stimuli  are  to  be  encountered  la  random  order.  He  found  that  subjects  had 
great  difficulty  in  holding  in  mind  tbs  information  treat  successive  trials; 
there  is  evidently  enormous  retroactive  ixihibition  when  the  subject  has  not 
succeeded  in  organising  the  stlaailua  set  conceptually.  (In  one  preliminary 
study  a  brifd^t  subject  solved  our  basic  eirds-cross  problem  in  five  trials 
and  gave  correct  responses  consistently  thereafter.  Turning  to  another 
problem  of  the  same  sort^  sttpposedly  of  the  sanm  difficulty,  he  was  still 
perf arming  at  a  random  level  after  2^  trials.  The  process  of  happening  on 
a  fruitful  hypothesis  is  manifestly  unreliable  in  a  strange  situation.)  The 
failure  of  subjects  to  learn  fooroed  us  to  reduce  the  nunber  of  degrees  of 
freedom  in  the  stlaulua  sltTUition  to  four.  The  stloulus  used  tbroufbout  our 
studies  consisted  essentially  of  a  square  containing  two  points 

...  located  on  a  grid.  In  the  i960  study  the  points  were  indicated  as  a 
circle  and  cross.  In  the  1961  expwrimsnt  we  used  an  arrow  connecting  the 
two  points.  The  x  and  2  coordinates  of  the  points  could  take  on  values  1,  2, 
or  U;  the  correct  answer  was  a  weighted  average  of  the  two  x  coordinates 
(circle  or  bead  of  arrow  weighted  more) .  Hhils  it  was  posslbie  for  S  to  use 
many  diverse  cues  (e.g.,  distance  of  circle  from  comer),  we  confined  analysis 
to  the  crlterlalltles  of  the  x  and  2  coordinates. 

Brunswlk's  concept  of  a  crlteriality  calls  for  confuting  eorralatlons 
between  reaponses  and  cuss.  It  was  his  view  that  in  perceptual  learning  one 
comes  to  recognise  the  validity  of  various  cuss  (e.g.,  of  surface  dlfferen* 
tiation  es  a  cue  to  distance),  and  that  the  cue-response  correlatioo 
(oriteriality)  could  he  conpo^  with  the  oorrelatlon  between  cue  and  correct 
response  (validity).  Such  a  correlation  would  be  determlnBd  over  all  objects 
in  the  ecological  envlranment.  While  such  correlations  can  certainly  he  ; 
calculated,  we  found  that  this  model  does  not  correspond  well  to  responae 
processes  In  a  ooncept-formatioa  task.  Both  the  subjects'  response  protoct^a 
Apd  their  verbalizations  Indicate  that  hyi>othe8is  formation  does  not  proce^ 
througi  a  modification  of  cue-raaponse  contlnganclea .  Bather,  there 

la  a  ^nrmt-A  mifnia  procasB.  S  forms  a  bjfpotbesls  about  a  subset  of  tbs 
atimuU  end  modlflea  it  if  lt~le  disconfirmed.  At  tha  and  of  tha  training, 
ha  may  well  hanre  a  set  of  such  hypotbeaes,  each  applying  to  a  different  subset 
of  the  stimuli;  there  may  be  eddlticnal  stimuli  not  yet  falling  into  any  a^- 
set.  Oue  such  "Type  hypothesis”  is  the  rule  that  "wW  the  circle  and  woes 
fall  in  the  same  column,  the  ntmber  of  the  column  gives  the  value  of  k." 

(This  hypothesis  is  correct  in  our  problem.) 

Ibe  over-all  crlteriality  gives  a  gross  measure  of  cue-response  corre- 
spoudence,  but  to  reproduce  S’s  prooeeses  a  ■Wo-step  amthmaatical  model  with 
sepaurate  fonmilas  for  determining  "Type"  auod  for  determining  response  given 
Type,  or  a  coogplex  nonlinear  formula,  would  be  required.  There  appears  to  be 
little  possibility  of  actually  flttl^  such  models,  because  large  nuabera  of 
data-polnts  asm  needed  to  determine  cmuplanc  aurfacea.  Since,  on  any  trial 
wbsre  feedback  la  given,  S  may  modify  bis  hypothesis-system,  the  function 


k 


to  bo  flttod  ctaanaM  Instoad  of  fitting  an  ovnr-all  function, 

one  can  try  to  aceount  for  S's  responoas  by  oategorising  the  stlaull  a  priori 
and  awrinlng  orltarlalitles  within  each  subset.  In  our  study,  it  nada  sense 
to  s«d>diTide  Btinuli  according  to  the  absolate  difference  between  2 
coordinates  of  circle  and  cross,  since  aauiy  subjects  raported  rules  involTlng 
ttasae  four  categories  as  types.  In  the  initial  esperlMnt,  however,  the 
distribution  of  stiaili  provided  relatively  few  examples  of  certain  types, 
and  did  not  space  the  types  systeaatlcally  over  the  training  aeries.  Within 
such  '^rpas  the  distributions  of  x  and  x*  were  no  longer  rectangular  over  the 
range  1-^.  (Fartioularly,  for  x"-  x*  >  x  and  x'  were  never  eqpal  to  S  or 
^.)  Tbs  corxelational  index  of* eri^lality  Is,  lihe  all  correlations, 
affected  by  changes  in  the  range  of  varlablea}  it  therefore  does  not  serve 
to  describe  cue-response  relations  within  types. 

Tto  cope  with  these  difficulties,  several  oodifioationa  were  introduced 
Into  the  1961  experlawot:  (l)  The  types  defined  a  priori  were  presented  to 
the  subject  wl'Ui  eqpal  frequencies.  (2)  Series  of  "test"  trials  without 
feedback  ware  Introduced  at  aeveral  points  in  the  tradning  series  to  penalt 
ooUectlon  of  numerous  data-polats  while  S  was  presuaeibly  in  a  steady  state. 

(3)  Saoh  stlmilus  was  repeated,  the  two  pfeaentatlcos  being  shout  16  trials 
apart,  in  ordsr  to  provide  evidence  of  "rellehillty."  Lack  of  consistency 
loplied  that  8  had  not  settled  upon  an  hypothesis,  (b)  The  absolute  distance 
behieen  response  and  cue  was  eapl^ed  Instead  of  the  correlational  criterlallty; 
this  measures  the  extent  to  which  the  responses  "track*  a  certain  cue  but,  as 
we  wished,  is  insensitive  to  changes  in  the  range  of  tbs  cue. 

Although  hLL  these  modifications  appeared  to  be  desirable,  they  did  not 
elioinste  our  difficulties.  For  one  thing,  Sfs  were  exposed  to  relatively  few 
exanples  of  any  one  type  of  stimulus,  and  therefore  had  difficulty  settling 
upon  good  hypotheses.  Rellehillty  was  freq.uently  low.  So  much  confusion  was 
generated  that  a  subject  often  abandoned  or  altered  a  rule  for  one  type  of 
problea  that  had  been  giving  him  success.  This  was  presumably  a  conseqjuenee 
of  bis  failures  on  the  interspersed  problenB  of  other  types.  Sven  during 
test  larials,  subjeete  were  ziot  "in  a  steady  state."  There  was  seem  evldsnce 
that  Ss  changed  their  hypotheses  even  in  the  middle  of  a  series  with  no  feed¬ 
back.'*  Jids  can  be  attributed  either  to  their  InehlUty  to  bold  hypotheses  in 
mind  or  to  lack  of  o<»fldence. 

He  ore  farced  to  the  conclusl(»  that  the  chief  aim  of  oriterlality 
analysis— to  trace  objectively  the  emergence  and  modification  of  hypotheses— 
cannot  be  realised  in  the  sort  of  experiment  we  have  carried  out.  Various 
further  possibilities  suggest  themselves.  If  the  training  series  were 
"progremed"  so  as  to  provide  a  regular  ptro^esalon  of  sciBS  sort,  with  rather 
fteqpent  repetition  of  Items,  Ss  would  prehahly  hove  greater  success  and 
their  hypotbeaes  would  hecoms  more  stable.  In  this  study  we  held  to  a  random 
sequence  of  stimuli  in  ordsr  to  study  a  process  ressribllng  concept  formstloa 
"m  the  real  world,"  vhsj.e  msnbera  of  the  stimalua  olasa  are  preaumably 
encountered  in  random  order.  To  Introduce  controlled  stimulus  sequences 
shifts  us  to  a  study  of  teaching  as  well  as  of  learning.  A  second  possibili'^ 
is  CO  allow  S  freedom  in  selectixig  stimuli,  so  that  he  can  explore  systematically 
and  perhaps  build  up  his  concept  by  easy  stages.  Here,  the  "strategies"  of  the 
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ingfad  of  tb*  deolalong  of  a  sarognanr  teoans  an  iavortant  varlaiblai 
Ililrd,  one  adi^t  prolong  tiia  training  on  tbe  hypotteala  that  unraliaiblllty 
(inathbilltgr  of  harpothaaea)  la  charactarlatic  of  tha  firat  200  trlala  or  bo, 
and  that  graatar  atablUty  could  ha  ohaarvad  latar. 

nia  failnra  of  oritarlality  analarala  in  tha  uaa  to  lAlch  va  (liha 
Saadaltmd  and  Brunar)  put  it  would  not  have  aurprlaed  Brunmrik.  In  an 
tmpwhllahad  papar,  ha  dlaeuaaad  at  langth  a  diatlnctlon  hotwaan  rational 
and  peroaptual  proeaaaaa,  hypothaaisiag  that  gradual  laarning  of  prcibaibilltiaa 
oharaotariaaa  tha  lattar  whlla  tha  foxaar  ia  aarked  by  dallbarata  oonatructlon 
and  discarding  of  hypothasas.  Battooal  laarning  procaads  with  Arupt  dlacon- 
tinuitlas,  rathar  than  by  Ijaparoaptibly  aacll  inprovaaanta  in  approadiaatian. 

Tha  diatlnotioo  Brunavik  aakas  apparently  baa  sona  validity.  Our  findings 
ara  conslatant  with  hla  ekpactaticna.  Dulany  finds  hypothaala  foniistloa  and 
conflznation  prooinant  in  vazhal-oondltloiiing  phanenana.  The  "ain^ -trial" 
learning  reportad  by  Bates  and  Bewer  nay  also  conform  to  Brunswlk's  dsscrlptlon 
of  rational  learning.  To  establiA  more  clearly  where  performance  is  described 
by  each  of  Brunswlk's  models,  attantloa  should  be  paid  to  the  classifleatlan  of 
tasks. 


In  paaslng,  we  may  note  a  new  possibility  of  "ratlonorphlc"  training. 
Dulany  and  O'Connell  (unpublished,  also  Varplanck-Oskaap,  unpublished)  find 
that  H)  learning  with  response  reinfavotmat  (such  as  we  used)  Is  successful 
for  most  subjectsi  (11)  learning  where  S  states  hla  rule  on  each  trial  and 
is  rclztforced  If  hla  response  la  right  even  If  the  rule  la  not  la  aaaeh  faster; 
and  (ill)  Aera  the  reiaforeemant  Is  attached  to  the  rule  learning  comas  euch 
harder.  But,  and  this  Is  legortent  for  us,  learning  of  type  ill  seems  to  be 
highly  stable  even  under  partial  reinfareement  (misinfaniiatlon) .  Berbaps 
eanceptrfozmtlon  studies  (and  Inductive  educational  procedures)  should  use 
the  type  111  design. 

Results.  While  we  were  not  Ale  to  obtain  from  our  dealgn  all  that  we 
had  hoped  for,  conclusions  can  be  drawn  sfbout  group  trends  in  this  type  of 
coneept-formation  task.  Tbs  group  acveragsa  show  a  steady  Increase  in 
criterlalltieB  for  tha  two  relevant  cues,  and  a  decline  from  a  low  initial, 
asan  criterlallty  to  aero  for  the  irrelevant  cues.  The  more  beaevUy  welgited 
of  tbs  two  relevant  cues  had  a  higiar  criterlallty,  throughout  the  series  of 
trials,  than  the  less  relevant  cue.  The  criterlallty  of  this  lass  relevant 
cue  generally  developed  later  than  that  for  the  8tri»gsr  cue. 

Individual  differences  were  resarkAly  cnnslstent  from  the  beginning  to 
the  end  of  the  training.  The  correlation  between  accuracy  score  over  trials 
^3-64  and  score  over  trials  97-128  was  .93;  this  is  muA  hlgw^  ^  usual 
Interblock  correlation  in  associative  laarning.  Evidently,  sAJects  who  have 
not  attained  a  workSbls  (if  tecoglate  or  ioparocise)  hypothesis  A  the  end 
of  32  trials. make  little  progress  on  later  trials.  Verbal  reports  (coUected 
In  tha  1961  experimsnt)  show  that  poorer  Ss  characteristically  lling  to  a 
wrong  hypothesis.  Qba  S,  for  ersaple,  decided  early  to  try  to  relate  k  to 
the  length  of  the  arrowT  After  32  trials  be  admitted  that  this  did  not  '•'ork. 
Monetheless,  throuf^ioat  the  126  trials  with  feedback  that  foUowad,  be  clung 
to  this  basic  hypothesis,  elaborating  It  in  various  ways  to  rationalise  Ite 
failures  (shades  of  Ptol^!) .  Bavelaa  (personal  cooaunloatiaa)  finds 
elAoratlon  of  hypotheses  rathar  than  return  to  persimonloua  alternatives 
the  eompan  response  of  collage  atudante  to  disconfiniiatioa  (whiA  ia  partially 
reixiforeing  over  a  saxlaa  of  trials). 
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Baopeetancy  of  ■^infomativa  f— db«ck.  Tbc  I96I  eacpsriaBiit  oonfixas 
thtae  <meixuilw  and  deals  ulth  two  natr  eagwlmantal  variables.  Xba  first 
vas  axjieetaney  of  mialnfOrBatlvs  feedback.  Noting  tbe  aerlous  dlaruptioa  of 
BOOB  Btudente  vben  tbelr  respoose ;  proved  ttrong,  «e  entertained  tbe  idea 
that  provldlag  an  advance  rationalisation  for  errors  acLgtit  nocourage  tb»m  to 
bold  to  an  bypotbesla  with  afaieb  they  bad  received  soaie  success,  instead  of 
discarding  it  bodily  and  aearebing  vildly  for  a  new  concept.  Subjects  in 
tbe  eaipectaacy  condition  were  given  an  eaqplanation  about  our  desire  to 
siaulate  conditions  of  scientific  investigation,  where  instrument  errors  and 
tbs  like  soiaetlmes  provide  mlBinfonBatlon.  During  preliminary  warm-up  train¬ 
ing,  a  small  error  vas  Introduced  into  tbe  feedback  on  8  oat  of  10  trials;  at 
tbs  end  of  tbe  tenth  trial,  this  was  called  to  Sjs '  attention.  During  the 
training  trials  themselves,  feedback  vas  Invari^Iy  accurate.*  lbs  control 
group  was  given  rougb^iy  similar  instructions  except  that  there  was  no 
suggestion  of  error  in  tba  feedback.  Uhls  differs  fron  the  usual  studies  of 
misinformatlve  feedback  (and  vbat  is  eesentlnlly  equivalent,  probability 
learning)  in  that  the  key  variable  la  tha  subject's  expectancy  rather  than 
the  actual  misinformatloa.  Since,  from  the  subject 'a  point  of  view,  there 
is  ZU3  way  of  dlatlnguiahlng  misinformation  from  information  consistent  with 
the  experimenter  'a  predatexmined  concept,  tbe  variable  of  expectancy  sseos 
of  particular  psychologiaal  importance.  Tbe  results  abowed  that  tbe  group 
expecting  erroneous  feedback  was  aignlficantly  handicapped  on  the  subset  of 
prcblems  where  x^  »  (°  k) .  Ttaia  type  of  problem  is  much  easier  than  tbe 

other  types.  On  tbe  more  difficult  sxdbsets,  there  was  no  difference  between 
groups. 

Tbe  scientist,  Interpretizig  eetplrlcal  data,  is  rendered  better  able  to 
theorise  by  having  an  expectancy  of  mislnformatioa  (a.g.,  from  aegqpllng  error) 
^dtich  allows  him  to  tolerate  irsregularities  in  data.  He  raises  bis  eyes  to 
search  for  main  trends,  without  eonoem  for  tbe  minor  anoamlies  in  bis 
observations.  In  our  experiment,  however,  tbe  expectation  of  error  seems  to 
have  blinded  a  good  many  subjects  to  the  fact  that  whenever  circle  vas  above 
or  below  cross  in  a  certain  colmm,  tbe  nunber  of  that  colusn  was  tbe  correct 


*The  device  used  vas  this.  On  each  card  was  a  square  of  tape. 

It  was  explained  that  beneath  this  vas  a  nuober  (e.g.,  0.2)  vblch  represented 
"instrument  error"  such  as  a  scientist  most  learn  to  deeO.  with.  Host  of  the 
time  this  number  vas  zero,  but  on  some  trials  it  might  depart  from  aero  and 
if  so,  this  figure  vas  adted  to  or  subtracted  frcm  k  to  determine  the  feed¬ 
back  report.  At  the  exid  of  the  pretraining  trials  the  tape  vas  lifted  from 
two  or  three  cards  to  show  the  presence  or  absence  of  such  errors.  There 
were,  of  course,  no  nusbers  xtnder  the  tape  during  tbe  main  training  series, 
tbougb  tbe  tape  vas  continually  present  as  a  reminder  of  tbe  possibility  of 
error. 
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reaponse.  In  tbs  control  group  lU  out  of  l6  learned  thla  principle,  eoapared 
vlth  8  out  of  15  In  tbe  group  expecting  olBlnfonaatlon.  In  an  iirmihllahad 
experlnent,  Edwards  also  finds  that  eagpectancy  of  olslnforaatlon  baa  a 
detrlnsntal  effect.  our  results  suggest  an  Interaction  hetMean  this 

variable  and  concept  difficulty,  our  design  does  not  perait  us  to  establish 
this  as  a  finding.  Over  successive  porobleas  we  would  expect  subjects  to 
learn  to  cope  with  nlsiDforiBBtlve  feedbaoh.  !Ebey  oust  develop  a  data- 
processing  strategy  that  esphasises  gross  effects  rather  than  trlal-hy-trlal 
accuracji  /  Ihe  present  study  throws  no  light  on  idiether  such  a 

strategy  would  eaerga  tram  continued  training  on  aany  prohleos.  One  way  to 
encourage  subjects  to  observe  trends,  and  not  to  be  excessively  sensitive  to 
i yniat--< of  partially  correct  hypotheses,  may  be  to  use  block  feed¬ 
back  rather  than  single-trial  feedback*  While  "iBnediate"  feedback  usually 
proBiotes  learning.  It  nay  well  be  that  in  a  difficult  eoncapt-attalnnent 
task  trlal-by-trlal  feedback  is  acre  harassing  than  helpful.  Where  we  wish 
to  confirm  and  shape  the  mediating  proeaee  rather  than  the  response  Itself, 
it  may  be  better  to  give  block  feedback,  reporting  a  total  error  score  for 
the  last  X  trials,  aTter  every  ^th  trial.  (Perhape,  tar  our  task.  It  would 
be  sultSbXe  to  let  x  ■  10  and  2  ■  this  la  a  natter  to  be  detexnined 
enpirlcally.) 


Stlnulus  dlverelty.  'I'ha  second  eagperinental  variable  was  the  degree  of 
continuity  of  the  trailing  series.  In  all  cooditloos  previously  discussed, 
the  coordinates  3^  x',  y,  y'  took  cm  only  values  1,  2,  snd  b,  these  values 
being  narked  by  grid  lines  within  tbe  scpiare.  Stinull  of  this  sort  are 
called  a  stinull.  Xhe  control  group  received  only  a  items.  Xbe  experimental 
group  was  presented  with  a  series  of  mixed  Ot  and  i3  Itema,  g  items  being  those 
where  x  or  x*  (or  both)  were  I.5,  2.5,  or  ^  il>s  present  experiment, 

feedback  was  always  given  as  a  decimal  fraction  (e.g.,  if  x  «  1  and  x'  ■  2, 
k  •  1.5)  and  S  was  encouraged  to  estimate  k  to  one  declmalT  It  was  thought 
ttiat  the  more~continuous  series  would  produce  hypotbesea  different  in 
character  from  those  fonned  under  control  conditions,  in  particular,  that 
there  mi^t  be  a  greater  tendency  to  establish  an  over-all  hypothesis  rather 
than  separate  hypotheses  for  separate  "types"  of  items. 

While  the  training  series  for  tbe  experimental  and  control  groups 
differed,  tbe  test  series  were  the  same.  Four  test  series  (A-D)  were 
Interspersed  in  the  training,  all  of  them  confined  to  a  items.  Ibe  end-of!^ 
trcULnlng  test  used  a  mixture  of  a  and  g  items;  separate  scores  E(a)  and  S(^} 
were  obtained  for  these  twp  types  of  Iteps.  A  priori,  we  expected  the 
experimental  group  to  have  an  advantaga  on  EO)  itenm.  Neither  group 
discussed  here  was  led  to  expect  mislnfoimatiye  feedback. 

On  Tests  A-E(a)  the  control  group  trained  on  oc  items  cxily  bad  an 
advantage.  Of  particular  Interest  is  a  coiBp8ri8on~of  E(a)  data  with  a  retest 
on  the  same  items  a  week  later.  Tbe  experimental  group  was  poorer  on  the 
Imnediate  test  and  very  slightly  superior  on  the  retest.  This  "sleeper 
effect"  (of  borderline  elgnlflcatuse  here)  is  of  considerable  importance  if 
confirmable.  Tbe  teat-retest  correlation  was  .91  for  the  control  group  and 
.Ji  for  tbe  ejgperlmental  group  (dlff.  not  signlf leant) .  The  galsc  that 
occurred  were  often  q]aite  large,  and  suggest  that  hypotheses  were  in  some 
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way  conaoUdated  and  slapllfled  durlag  the  interval.  On  teat  tba 
groups  vans  close  togather— tba  eapaetad  advantage  for  tbe  aaparimantal 
group  did  not  appear. 

It  is  our  plan  to  report  tbeae  dbeervarbiooB  in  a  paper  which  has  been 
partly  drafted.  Additional  studies  in  tbe  sane  vein  are  being 
tbe  Training  Research  Laboratary  under  tbs  direction  of  Rrofessor  Stolurov. 
ms  one  study  coapletsd  is  a  repUcaticn  by  Thnaiaa  McBale  of  tbe  i960  study. 
Ae  analysis  was  eonflaed  to  group  criteriality  scoresp  the  oy^r 

trials  oonftreed  Iha  original  Asuas  study.  Current  work  is  ^tb 

eiallar  stlauU  and  anal^o  netbode,  but  is  introducing  syetemtic  order 
("programing'')  aaong  stimuli  in  order  to  eake  tbe  task  easier. 


Probabiliatie  feedback  '- 

In  the  i960  stody,  a  group  was  run  under  a  probabilistic  fsadbaok 
eoi^tiaa.  Wbaraas  in  tbe  deteralnistio  condition  the  correct  nniwr  was . 
a  linear  eongoaite  of  x  and  x*  (rounded  to  the  nearest  integer)^  in  the 
probebiliatio  condition  elti^  xaatx*  was  equal  to  the  corract  xasponseji 
x*  being  aeleoted  aa  correct  0^1%  "at  the  atiaull  where  x  and  x*  differed. 

&e  subject  was  led  to  believe  thet  there  was  a  definite  nile  wMov.  «ould 
give  him  a  correct  eatimate  of  k;  thus  tbe  task  appeared  to  S  as  a  '^oblmn- 
solving"  rather  than  a  "gamblinj"  task.  This  study  is  reported  in  a  paper 
in  press,*  and  therefore,  despite  the  significance  of  the  results,  ^ 
reported  here  only  in  abstraot. 

On  items  idiere  x  «  x',  thect  coordinate  provides  a  perfectly  dependable 
cue  and  moat  of  our  M  learned  to  use  it.  There  was  no  evidence  nf>>» 
hitfily  valid  cues  w^  'Vaidezvalued"  as  they  were  in  R.  Ooodnow's  study.  On 
the  items  (x  ^  x')  where  k  »  x  wi12i  P  ■  .7$,  our  more  successful  Se  generally 
made  k  «  x  m  8?-1j00](  of  the  trials."*  This  contradicts  the  J.  CkM^iow-Bruner 
view  'i^t'""event  matching"  is  to  he  expected  in  "prohlem-solving''  tasks. 

Her  did  we  find  the  result,  predicted  tiy  Bruner  et,  al  and  observed  l^v  the 
R.  Gtoodnow  data,  of  more  frequent  all-or-none  hehacvlar  (x  used  as  response  on 
all  trials)  during  the  test  blocks.  " 

It  appears  that  with  probabilistic  feedback  and  multivariate  stimuli,  S 
tends  to  follow  the  more  valid  ciw,  and  that  this  tendency  increases  aa 
training  progreasea.  3  uses  any  of  the  cues,  relevant  or  irrelevant,  to 
define  aubclaases  of  stimuli  for  idileh  he  should  rely  on  the  leas  valid  cue. 

He  does  not  seem  to  use  hypotheses  ebout  response  sequence.  Criterlalitles 
are  not  helpful  in  analyzing  his  hypotheses  becaia  e  they  must  be 
over  a  larfp  series  of  trials  and  follow  a  linear  model  whereas  tlte  hypotheses 
S  uses  are  conflgural. 


*H.  Azuma  and  L.  J.  Crohbach,  "Concept  attainment  with  probabilistic 
feedback,"  In  K.  E.  Hammond  (ed.),  Probabiliatie  funetipnaliam: 

Peyohology  (Berkeley:  University  of  Callfotmla  Press,  in  press) .  ”” 
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